The buyer received poor investor response to the pricing of the share sale.
Authorities are checking deals involving more than three dozen companies.
The FinMin has built up a cash surplus of about Rs 80,000 crore.
Investors including units of Morgan Stanley and Citigroup have agreed to buy 28.3 million shares of Bharti Infratel at Rs 230 apiece.